GSAL: Geometric structure adversarial learning for robust medical image segmentation

• A new learning mechanism for medical image segmentation. We introduce a novel Geometric Structure Learning Mechanism (GSLM) that enhances model learning "focus, path, and difficulty". It enables geometric structure attention learning to bridge image features with large differences, thus capturing the contextual dependencies of images. The image features maintain consistency and continuity along the internal and external geometry structure, which improves the integrity and boundary accuracy of the segmentation results. To the best of our knowledge, we are the first attempt to explicitly establish the target's geometric structure, which has been successfully applied to medical image segmentation. • A novel geometric structure adversarial learning for robust medical image segmentation. We present the geometric structure adversarial learning model (GSAL) that consists of a geometric structure generator, skeleton-like and boundary discriminators, and a geometric structure fusion sub-network. The generator yields the geometric structure that preserves interior characteristics consistency and external boundary structure continuity. The dual discriminators are trained simultaneously to enhance and correct the characterization of interior structure and boundary structure, respectively. The fusion sub-network aims to fuse the geometric structure that optimized by adversarial learning to refine the final segmentation results with higher credibility. • State-of-art results on widely-used benchmarks. Our GSAL achieves SOTA performance on a variety of benchmarks, including Kvasir&CVC-612 dataset, COVID-19 dataset, and LIDC-IDRI dataset. It confirms the robustness and generalizability of our framework. In addition, our method has great advantages in terms of the integrity and boundary accuracy of the segmentation target compared to other competitive methods. GSAL can also achieve a considerable trade-off in terms of accuracy, inference speed, and model complexity, which helps deploy in clinical practice systems. Automatic medical image segmentation plays a crucial role in clinical diagnosis and treatment. However, it is still a challenging task due to the complex interior characteristics (e.g. , inconsistent intensity, low contrast, texture heterogeneity) and ambiguous external boundary structures. In this paper, we introduce a novel geometric structure learning mechanism (GSLM) to overcome the limitations of existing segmentation models that lack learning "focus, path, and difficulty." The geometric structure in this mechanism is jointly characterized by the skeleton-like structure extracted by the mask distance transform (MDT) and the boundary structure extracted by the mask distance inverse transform (MDIT). Among them, the skeleton-like and boundary pay attention to the trend of interior characteristics consistency and external structure continuity, respectively. With this idea, we design GSAL, a novel end-to-end geometric structure adversarial learning for robust medical image segmentation. GSAL has four components: a geometric structure generator, which yields the geometric structure to learn the most discriminative features that preserve interior characteristics consistency and external boundary structure continuity, skeleton-like and boundary structure discriminators, which enhance and correct the characterization of internal and external geometry to mutually promote the capture of global contextual dependencies, and a geometric structure fusion sub-network, which fuses the two complementary and refined skeleton-like and boundary structures to generate the high-quality segmentation results. The proposed approach has been successfully applied to three different challenging medical image segmentation tasks, including polyp segmentation, COVID-19 lung infection segmentation, and lung nodule segmentation. Extensive experimental results demonstrate that the proposed GSAL achieves favorably against most state-of-the-art methods under different evaluation metrics. The code is available at: https://github.com/DLWK/GSAL. [ BSTRACT FROM AUTHOR] Copyright of Pattern Recognition is the property of Pergamon Press - An Imprint of Elsevier Science and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full . (Copyright applies to all s.)

SD-GAN: A Style Distribution Transfer Generative Adversarial Network for Covid-19 Detection through X-ray Images

The Covid-19 pandemic is a prevalent health concern around the world in recent times. Therefore, it is essential to screen the infected patients at the primary stage to prevent secondary infections from person to person. The reverse transcription polymerase chain reaction (RT-PCR) test is commonly performed for Covid-19 diagnosis, while it requires significant effort from health professionals. Automated Covid-19 diagnosis using chest X-ray images is one of the promising directions to screen infected patients quickly and effectively. Automatic diagnostic approaches are used with the assumption that data originating from different sources have the same feature distributions. However, the X-ray images generated in different laboratories using different devices experience style variations e.g., intensity and contrast which contradict the above assumption. The prediction performance of deep models trained on such heterogeneous images of different distributions with different noises is affected. To address this issue, we have designed an automatic end-to-end adaptive normalization-based model called style distribution transfer generative adversarial network (SD-GAN). The designed model is equipped with the generative adversarial network (GAN) and task-specific classifier to transform the style distribution of images between different datasets belonging to different race people and carried out Covid-19 detection effectively. Evaluated results on four different X-ray datasets show the superiority of the proposed model to state-of-the-art methods in terms of the visual quality of style transferred images and the accuracy of Covid-19 infected patient detection. SD-GAN is publicly available at: https://github.com/tasleem-hello/SD-GAN/tree/SD-GAN. Author

Immunity and security using holism, ambient intelligence, triangulation, and stigmergy: Sensitivity analysis confronts fake news and COVID-19 using open set transduction.

This paper introduces a multi-faceted security methodology based on Holism, Ambient Intelligence, Triangulation, and Stigmergy (HATS) to combat the spread of current pandemics such as fake news and COVID-19. HATS leverages the apparent complementarity and similarity of physical and mental pandemics using adversarial learning and transduction to promote immunity on both using conformal prediction and principled symbiosis. As such, HATS confronts both mental and physical adversity found in misinformation and disinformation. It confers herd immunity using holism and triangulation that call to advantage on sensitivity analysis using open set transduction and meta-reasoning. Ambient intelligence and stigmergy further mediate meta-reasoning and re-identification in building and sharing immunity. As change is constant and everything is fluid, as truth is not always reality and reality is not always truth, and as truth is imponderable and lie can become truth, two things have to happen. First, reconditioning and reconfiguration engage random deficiency to discern familiarity from strangeness and a-typicality. Second, transfer learning using trans-adaptation and transposition, serve adaptation and interoperability. Together, this empowers open set transduction in facing adaptive persistent threats such as deception and denial when it engages moving target defense using modification and de-identification. Immunology and security further come together using to advantage the coupling of active and adversarial learning.

MTSS-AAE: Multi-task semi-supervised adversarial autoencoding for COVID-19 detection based on chest X-ray images.

Efficient diagnosis of COVID-19 plays an important role in preventing the spread of the disease. There are three major modalities to diagnose COVID-19 which include polymerase chain reaction tests, computed tomography scans, and chest X-rays (CXRs). Among these, diagnosis using CXRs is the most economical approach; however, it requires extensive human expertise to diagnose COVID-19 in CXRs, which may deprive it of cost-effectiveness. The computer-aided diagnosis with deep learning has the potential to perform accurate detection of COVID-19 in CXRs without human intervention while preserving its cost-effectiveness. Many efforts have been made to develop a highly accurate and robust solution. However, due to the limited amount of labeled data, existing solutions are evaluated on a small set of test dataset. In this work, we proposed a solution to this problem by using a multi-task semi-supervised learning (MTSSL) framework that utilized auxiliary tasks for which adequate data is publicly available. Specifically, we utilized Pneumonia, Lung Opacity, and Pleural Effusion as additional tasks using the ChesXpert dataset. We illustrated that the primary task of COVID-19 detection, for which only limited labeled data is available, can be improved by using this additional data. We further employed an adversarial autoencoder (AAE), which has a strong capability to learn powerful and discriminative features, within our MTSSL framework to maximize the benefit of multi-task learning. In addition, the supervised classification networks in combination with the unsupervised AAE empower semi-supervised learning, which includes a discriminative part in the unsupervised AAE training pipeline. The generalization of our framework is improved due to this semi-supervised learning and thus it leads to enhancement in COVID-19 detection performance. The proposed model is rigorously evaluated on the largest publicly available COVID-19 dataset and experimental results show that the proposed model attained state-of-the-art performance.

Semi-Supervised Adversarial Learning Using LSTM for Human Activity Recognition.

The training of Human Activity Recognition (HAR) models requires a substantial amount of labeled data. Unfortunately, despite being trained on enormous datasets, most current models have poor performance rates when evaluated against anonymous data from new users. Furthermore, due to the limits and problems of working with human users, capturing adequate data for each new user is not feasible. This paper presents semi-supervised adversarial learning using the LSTM (Long-short term memory) approach for human activity recognition. This proposed method trains annotated and unannotated data (anonymous data) by adapting the semi-supervised learning paradigms on which adversarial learning capitalizes to improve the learning capabilities in dealing with errors that appear in the process. Moreover, it adapts to the change in human activity routine and new activities, i.e., it does not require prior understanding and historical information. Simultaneously, this method is designed as a temporal interactive model instantiation and shows the capacity to estimate heteroscedastic uncertainty owing to inherent data ambiguity. Our methodology also benefits from multiple parallel input sequential data predicting an output exploiting the synchronized LSTM. The proposed method proved to be the best state-of-the-art method with more than 98% accuracy in implementation utilizing the publicly available datasets collected from the smart home environment facilitated with heterogeneous sensors. This technique is a novel approach for high-level human activity recognition and is likely to be a broad application prospect for HAR.

Multi-attention representation network partial domain adaptation for COVID-19 diagnosis.

The outbreak of COVID-19 threatens the safety of all human beings. Rapid and accurate diagnosis of patients is the effective way to prevent the rapid spread of COVID-19. The current computer-aided diagnosis of COVID-19 requires extensive labeled data for training, and this undoubtedly increases human and material resources costs. Domain adaptation (DA), an existing promising approach, can transfer knowledge from rich labeled pneumonia datasets for COVID-19 diagnosis and classification. However, due to the differences in feature distribution and task semantic between pneumonia and COVID-19, negative transfer may reduce the performance in diagnosis COVID-19 and pneumonia. Furthermore, the training data is usually mixed with many noise samples in practice, and this also poses new challenges for domain adaptation. As a kind of domain adaptation, partial domain adaptation (PDA) can well avoid outlier samples in the source domain and achieve good classification performance in the target domain. However, the existing PDA methods all learn a single feature representation; this can only learn local information about the inputs and ignore other important information in the samples. Therefore multi-attention representation network partial domain adaptation (MARPDA) is proposed in this paper to overcome the above shortcomings of PDA. In MARPDA, we construct the multiple representation networks with attention to acquire the image representation and effectively learn knowledge from different feature spaces. We design the sample-weighted strategy to achieve partial data transfer and address the negative transfer of noise data during training. MARPDA adapts to complex application scenarios and learns fine-grained features of the image from multiple representations. We apply the model to classify pneumonia and COVID-19 respectively, and evaluate it in qualitative and quantitative manners. The experimental results show that our classification accuracy is higher than that of the existing state-of-the-art methods. The stability and reliability of the proposed method are validated by the confusion matrix and the performance curves experiments. In summary, our method has better performance for diagnosis COVID-19 compared to the existing state-of-the-art methods.

Fine-Tuned Siamese Network with Modified Enhanced Super-Resolution GAN Plus Based on Low-Quality Chest X-ray Images for COVID-19 Identification.

Coronavirus disease has rapidly spread globally since early January of 2020. With millions of deaths, it is essential for an automated system to be utilized to aid in the clinical diagnosis and reduce time consumption for image analysis. This article presents a generative adversarial network (GAN)-based deep learning application for precisely regaining high-resolution (HR) CXR images from low-resolution (LR) CXR correspondents for COVID-19 identification. Respectively, using the building blocks of GAN, we introduce a modified enhanced super-resolution generative adversarial network plus (MESRGAN+) to implement a connected nonlinear mapping collected from noise-contaminated low-resolution input images to produce deblurred and denoised HR images. As opposed to the latest trends of network complexity and computational costs, we incorporate an enhanced VGG19 fine-tuned twin network with the wavelet pooling strategy in order to extract distinct features for COVID-19 identification. We demonstrate our proposed model on a publicly available dataset of 11,920 samples of chest X-ray images, with 2980 cases of COVID-19 CXR, healthy, viral and bacterial cases. Our proposed model performs efficiently both on the binary and four-class classification. The proposed method achieves accuracy of 98.8%, precision of 98.6%, sensitivity of 97.5%, specificity of 98.9%, an F1 score of 97.8% and ROC AUC of 98.8% for the multi-class task, while, for the binary class, the model achieves accuracy of 99.7%, precision of 98.9%, sensitivity of 98.7%, specificity of 99.3%, an F1 score of 98.2% and ROC AUC of 99.7%. Our method obtains state-of-the-art (SOTA) performance, according to the experimental results, which is helpful for COVID-19 screening. This new conceptual framework is proposed to play an influential role in addressing the issues facing COVID-19 examination and other diseases.

COVID-19 Identification from Low-Quality Computed Tomography Using a Modified Enhanced Super-Resolution Generative Adversarial Network Plus and Siamese Capsule Network.

Computed Tomography has become a vital screening method for the detection of coronavirus 2019 (COVID-19). With the high mortality rate and overload for domain experts, radiologists, and clinicians, there is a need for the application of a computerized diagnostic technique. To this effect, we have taken into consideration improving the performance of COVID-19 identification by tackling the issue of low quality and resolution of computed tomography images by introducing our method. We have reported about a technique named the modified enhanced super resolution generative adversarial network for a better high resolution of computed tomography images. Furthermore, in contrast to the fashion of increasing network depth and complexity to beef up imaging performance, we incorporated a Siamese capsule network that extracts distinct features for COVID-19 identification.The qualitative and quantitative results establish that the proposed model is effective, accurate, and robust for COVID-19 screening. We demonstrate the proposed model for COVID-19 identification on a publicly available dataset COVID-CT, which contains 349 COVID-19 and 463 non-COVID-19 computed tomography images. The proposed method achieves an accuracy of 97.92%, sensitivity of 98.85%, specificity of 97.21%, AUC of 98.03%, precision of 98.44%, and F1 score of 97.52%. Our approach obtained state-of-the-art performance, according to experimental results, which is helpful for COVID-19 screening. This new conceptual framework is proposed to play an influential task in the issue facing COVID-19 and related ailments, with the availability of few datasets.

NIA-Network: Towards improving lung CT infection detection for COVID-19 diagnosis.

During pandemics (e.g., COVID-19) physicians have to focus on diagnosing and treating patients, which often results in that only a limited amount of labeled CT images is available. Although recent semi-supervised learning algorithms may alleviate the problem of annotation scarcity, limited real-world CT images still cause those algorithms producing inaccurate detection results, especially in real-world COVID-19 cases. Existing models often cannot detect the small infected regions in COVID-19 CT images, such a challenge implicitly causes that many patients with minor symptoms are misdiagnosed and develop more severe symptoms, causing a higher mortality. In this paper, we propose a new method to address this challenge. Not only can we detect severe cases, but also detect minor symptoms using real-world COVID-19 CT images in which the source domain only includes limited labeled CT images but the target domain has a lot of unlabeled CT images. Specifically, we adopt Network-in-Network and Instance Normalization to build a new module (we term it NI module) and extract discriminative representations from CT images from both source and target domains. A domain classifier is utilized to implement infected region adaptation from source domain to target domain in an Adversarial Learning manner, and learns domain-invariant region proposal network (RPN) in the Faster R-CNN model. We call our model NIA-Network (Network-in-Network, Instance Normalization and Adversarial Learning), and conduct extensive experiments on two COVID-19 datasets to validate our approach. The experimental results show that our model can effectively detect infected regions with different sizes and achieve the highest diagnostic accuracy compared with existing SOTA methods.

Mobile Health (mHealth) Viral Diagnostics Enabled with Adaptive Adversarial Learning.

Deep-learning (DL)-based image processing has potential to revolutionize the use of smartphones in mobile health (mHealth) diagnostics of infectious diseases. However, the high variability in cellphone image data acquisition and the common need for large amounts of specialist-annotated images for traditional DL model training may preclude generalizability of smartphone-based diagnostics. Here, we employed adversarial neural networks with conditioning to develop an easily reconfigurable virus diagnostic platform that leverages a dataset of smartphone-taken microfluidic chip photos to rapidly generate image classifiers for different target pathogens on-demand. Adversarial learning was also used to augment this real image dataset by generating 16,000 realistic synthetic microchip images, through style generative adversarial networks (StyleGAN). We used this platform, termed smartphone-based pathogen detection resource multiplier using adversarial networks (SPyDERMAN), to accurately detect different intact viruses in clinical samples and to detect viral nucleic acids through integration with CRISPR diagnostics. We evaluated the performance of the system in detecting five different virus targets using 179 patient samples. The generalizability of the system was confirmed by rapid reconfiguration to detect SARS-CoV-2 antigens in nasal swab samples (n = 62) with 100% accuracy. Overall, the SPyDERMAN system may contribute to epidemic preparedness strategies by providing a platform for smartphone-based diagnostics that can be adapted to a given emerging viral agent within days of work.